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Response to Request for Continued Examination 

1 . RCE filed 1 1/07/2007 has been entered and made of record. 

2. Applicants' amendment has required new grounds of rejection. New grounds of 
rejection are therefore presented in the Office Action. 

3. Applicant's arguments have been fully considered but are moot in view of the 
new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1, 8, 13, 17; 2,9,14,18; 3,11,16,20; 4,12,15,19; 5,6,7,10,22 rejected 
under 35 U.S.C. 103(a) as being unpatentable over 

Fazzari (US-PAT-NO: 5887073) in view of 

Queiroz, "Mixed raster content (MRC) model for compound image compression" Proc. 
SPIE 3653, 1 106 (1998) and further in view of 

Brumitt US-PAT-NO: 6658136, "System and process for locating and tracking a 
person or object in a scene using a series of range images". 
(Note: if no name mentioned, please assume Fazzari reference.) 

0 Regarding Claims 1, 8, 17; 
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An apparatus, comprising: 

a blob (colors, properties, features, objects.) identifier {F\g3: 54. Col5 lines 15-20) 
tliat identifies one or more blobs (Col6 line 2: blobs) in image data; 
(Figure 5; 96, 98 and 1 GO were identified as blobs of 91 . 

Column 5, line 37, "FIG. 4, an attribute can be defined as a collection of points in red- 
green-blue space (RGB) space, which can be considered the same color for the sorting 
application." Column 10, lines 18-21, "70 first identifies as objects all spatially 
contiguous groups of pixels, i.e. blobs, in each binary attribute plane and each binary 
property".) a blob mapper {64) that assigns a color index (attribute) to each of one or 
more blobs based on a color property (Fig4: 92,93,94) of each of the blobs; and 
(Column 5, lines 55-56, "color classifier 64 shown in both of FIGS. 3 and 5 will classify 
each 24-bit RGB pixel from color image 91 into exactly one of these attributes.") 

a blob clusterer {F\g5. 64) that assigns the blobs to one or more binary 
foreground planes (88,90) and a grayscale background plane (89) based on the color 
index of each of the blobs 

(Figure 5; 96, 98 and 100 were identified as blobs of 91 . They were assigned to planes 
88, 89, 90 because they correspond to color clouds 92-94 in Figure 4. 96 belongs to 
color cloud 92; see Column 5, line 44 and Column 8, lines 35-45. The color classifier is 
a blob clusterer. 
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Column 5, line 58, "The color classifier does this by creating a binary image, or "attribute 
image," for each attribute from the 24-bit color image 91 that the color classifier 
processes.") 

to generate N- layer image data: and (Fig 5: 88,89,90.) 

Fazzari discloses everything as described above except, a blob identification 
module to maintain a global table of blobs that are no longer active: and 

Brumitt discloses, a blob identification module to maintain a global table (CollO 
lines 44, 48, 51,58, "table")_o^Wo^(Col10 line 44, "region". 308) that are no longer 
active: (CollO lines 44 "table" keeps track of all regions, including completed ones. 310 
"segmented regions" ) 

As Brumitt discloses, it is desirable to have a table tracking pixel-to region 
assignments (line 44), the table lists all regions including completed ones. This aids in 
image segmentation. Therefore, it would have been obvious to one having ordinary skill 
in the art at the time the invention was made to use Brumitt's method in Fazzari, a table 
keeping track of all regions including segmented ones for image segmentation. 

Fazzari and Brumitt disclose everything as described above except, data of the 
one or more assigned binary foreground planes and the grayscale background plane 
are compressed by applying separate compression algorithms to each binary 
foreground plane data and grayscale background plane data. 
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Queiroz discloses, data of the one or more assigned binary foreground planes 
and the grayscale background plane are compressed (Title, MRC) by applying separate 
compression algorithms (JPEG, JBIG) to each 

binary foreground plane data and (Page 4 Paragraph 2 "In both cases...", 
"text objects and edges are placed in the binary mask layer, thus, being efficiently 
encoded using standard binary coders such as MMR, JBIG") 

grayscale background plane data. (Page 4 Paragraph 2, JPEG) 

It is efficient to compress a binary image using JBIG and a continuous tone 
image, or image with "large uniform patches", with JPEG. Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to use Queiroz's MRC method in the combined method of Fazzari and Brumitt; encode 
binary image with JBIG and a continuous image with JPEG. 

0 Regarding Claims 13: 

A storage medium (Fazzari: 27) storing a set of program instructions executable 
on a data processing device (27), the set of program instructions (software) comprising: 
(Abstract: "control console displays a graphical user interface via a computer on which 
the control system is implemented and includes a software application pack specifically 
configured for processing a particular type of food." 

Column 4, lines 45-55, "A personal computer 27 implements a control processor 26 and 
memory-based software...") 

The rest of limitations of claim 1 3 are disclosed in Claim 1 . 
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0 Regarding Claims 2,9,14,18: 

(Queiroz reference.) 

The apparatus of claim 1, wherein the blob (Queiroz. Fig4: graphics, text) clusterer 
(Page4: regions containing text and graphics are identified and represented in a 
separate plane.) 

separates blobs (graphics, text) having a same color index (Fig4: Bird has the 
same color index) into one or more proximity groups (FG, M, BG planes) based on a 
predetenvined blob separation distance (Fig4: Bird's feet, stomach, wings, have the 
same separation distance in the original and BG plane.), and 

then assigns each of the proximity groups (objects) to a separate foreground 

plane, 

(Fig4 shows separate planes containing separate objects.) 

a size (dimension) of each of the foreground planes (Fig4) being set based on 
spatial characteristics of pixels of blobs assigned to each of the foreground planes. 
(Page 3 paragraph. 3: Layers may contain different dimensions and have offsets 
associated with them. If a plane contains only a small object, the effective plane can be 
made of a bounding box around the object.) 

0 Regarding Claim 10: 
(Queiroz reference.) 
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The method of claim 8, further comprising: setting a size (dimension) of each of 
the foreground planes based on spatial characteristics of pixels of blobs assigned to 
each of the foreground planes (Fig4). 

(Page 3 paragraph 3: Layers may contain different dimensions and have offsets 
associated with them. If a plane contains only a small object, the effective plane can be 
made of a bounding box around the object.) 

0 Regarding Claims 3,11,16,20: 

The apparatus of claim 1, wherein the blob clusterer assigns to a background plane one 
or more portions of the image data that are not assigned into any foreground plane. 
(89 in Figure 5 is the "Background Attribute Image." It contains unassigned data.) 

0 Regarding Claims 4,12,15,19: 

The apparatus of claim 1, wherein the blob mapper assigns an identical color 
index (attribute) to each of the one or more blobs, if a difference between color 
properties of the blobs is within a predetermined tolerance (Flg4: 92,93,94 is the 
tolerance). 

(Column 5, lines 52-56, "each attribute will have a corresponding color cloud in RGB- 
space. Once all attributes have been defined for a given application and corresponding 
color clouds have been created, the color classifier 64 shown in both of FIGS. 3 and 5 
will classify each 24-bit RGB pixel from color image 91 into exactly one of these 
attributes.") 
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0 Regarding Claim 5: 

JK xerographic marking device incorporating the apparatus of claim 1. 

(Column 7, lines 15-19 "Alternatively, any optical imaging device can be 
substituted for the camera, including a grey-scale video camera, a photocell device, a 
laser scanner, an ultraviolet camera, an infrared camera, a Magnetic Resonance 
Imaging (MRI) device, or a spectroscopic scanner.") 

0 Regarding Claim 6: 

A marl<ing device incorporating the apparatus of claim 1. 
(49 in Figure 2 is a pen, which is a marking device, incorporating the overall apparatus. 
Column 7, lines 15-19 "Alternatively, any optical imaging device can be substituted for 
the camera, including a grey-scale video camera, a photocell device, a laser scanner, 
an ultraviolet camera, an infrared camera, a Magnetic Resonance Imaging (MRI) 
device, or a spectroscopic scanner.") 

0 Regarding Claim 7: 

A digital photocopier incorporating the apparatus of claim 1. 
(Column 7, lines 15-19 "Alternatively, any optical imaging device can be substituted for 
the camera, including a grey-scale video camera, a photocell device, a laser scanner, 
an ultraviolet camera, an infrared camera, a Magnetic Resonance Imaging (MRI) 
device, or a spectroscopic scanner.") 
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0 Regarding Claim 22: 

Brumitt discloses, 22. (New) The apparatus of claim 1, wherein the blob (region) 
identification module merges (Coll 0 line 53 "merged") 

two or more previously separated blobs (Col 10 lines 49-50) into a single blob 

if the previously separated blobs become connected (collided. Coll 0 lines 49, 
"...if the current pixel is within one disparity of both neighbors and they are in different 
regions then these regions are deemed to have "collided" and a notation is made in the 
table for the pixel location that the two adjoining regions should be merged.") 

and the previously separated blobs agree in color. (Fazzari Figs 3-5, Col8 lines 
40-45. Fazzari discloses color classification and segmentation as described with regard 
to Claim 1.) 

6. Claim 21 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Fazzari 
(US-PAT-NO: 5887073) in view of Queiroz, "Mixed raster content (MRC) model for 
compound image compression", in view of Brumitt US-PAT-NO: 6658136 as applied to 
Claim 8 above, and further in view of Majid Rabbani, "An overview of the JPEG 2000 
still image compression standard", Signal Processing: Image Communication, 
Volume 17, Issue 1, January 2002, Pages 3-48. 
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0 Regarding Claim 21 : 

Fazzari and Queiroz disclose everything as described above except, creating a 
color tree from the assigned blobs. 

Rabbani, who deals with JPEG 2000, discloses on page 23 Fig 15, "Example of 
compressed data associated with various sub-bitplane coding passes"; on Page 27 Col 
2, "Component-position-resolution-layer progression (CPRL)". The color tree is the 
bitplanes from all the codeblocks, arranged from MSB to LSB, arranged by color 
component. 

Since Queiroz discloses on page 4 paragraph 2, "background plane is suitable 
for continuous tone image compressors such as JPEG or JPEG-2000", it would have 
been obvious to one having ordinary skill in the art at the time the invention was made 
to use Rabbani in the method of Queiroz, both are discussing JPEG 2000; partition data 
into codeblocks, where each codeblock Is arranged from most significant coefficients to 
least significant coefficients and arrange data in progression by component. This 
creates a color tree. 

Conclusion 

7. Prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. DeLeeuw discloses, "Placing and monitoring transparent user interface 
elements in a live video stream as a method for user input." 
Chang, US-PAT-NO: 6741655. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Max Shikhman whose telephone number is (571) 270- 
1669. The examiner can normally be reached on Monday-Friday 8:30AM-6:00PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, JINGGE WU can be reached on (571) 272-7429. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Infomnation regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status infomnation for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto,gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Max Shikhman 




